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Abstract 

We consider a broad class of queueing models with random state-dependent vacation peri- 
ods, which arise in the analysis of queue-based back-off algorithms in wireless random-access 
networks. In contrast to conventional models, the vacation periods may be initiated after each 
service completion, and can be randomly terminated with certain probabilities that depend on 
the queue length. We examine the scaled queue length and delay in a heavy-traffic regime, and 
demonstrate a sharp trichotomy, depending on how the activation rate and vacation probability 
behave as function of the queue length. In particular, the effect of the vacation periods may 
either (i) completely vanish in heavy-traffic conditions, (ii) contribute an additional term to the 
queue lengths and delays of similar magnitude, or even (iii) give rise to an order-of-magnitude 
increase. The heavy-traffic asymptotics are obtained by combining stochastic lower and up- 
per bounds with exact results for some specific cases. The heavy-traffic trichotomy provides 
valuable insight in the impact of the back-off algorithms on the delay performance in wireless 
random- access networks. 

1 Introduction 

We consider a broad class of queueing models with random state-dependent vacation periods. In 
contrast to conventional vacation models (see for instance [28] for a comprehensive overview), the 
server may take a vacation after each service completion and return from a vacation with certain 
probabilities that depend on the queue length. Specifically, when there are i customers left behind 
in the system after a service completion, the server either takes a vacation with probability 
with 1^(0) = 1, or starts the service of the next customer otherwise. Likewise, the server returns 
from a vacation and starts the service of the next customer at the first event of a non-homogeneous 
Poisson process of rate f{i), with /(O) = 0, when there are i customers in the system. 

In view of the vacation discipline, we analyze the queue length process at departure epochs, un- 
like most papers on vacation models which consider the queue length process embedded at instants 
when vacations begin or end. A notable exception is which studies an M/G/1 queue with 
a similar state-dependent vacation discipline, and establishes a stochastic decomposition property 
under certain assumptions. We show that this decomposition property in fact holds in far greater 
generality and corresponds to the Fuhrmann-Cooper decomposition. In addition, we obtain the 
exact stationary distributions of the queue length and delay for M/G/1 queues in three scenarios: 
(i) the probability V'(') decays geometrically as a function of the queue length, and the vacation 
is independent of the queue length; (ii) the probability ip{-) is inversely proportional to the queue 
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length, and the vacation is independent of the queue length; (iii) = 1 and the activation rate 
/(•) is proportional to the queue length. 

We further derive lower and upper bounds for the mean queue length and mean delay in two 
cases: the activation rate /(•) is fixed and the vacation probability V(') is a convex decreasing 
function; the activation rate /(•) is a concave or convex increasing function and ^(•) = 1. Various 
stochastic bounds and comparison results are established as well. 

We leverage the various bounds and stochastic comparison results to obtain the limiting distribu- 
tion of the scaled queue length and delay in heavy-traffic conditions. The heavy-traffic asymptotics 
exhibit a sharp trichotomy. The first heavy-traffic regime emerges in scenarios (ii) and (iii) de- 
scribed above. In this regime the scaled queue length and delay converge to random variables with 
a gamma distribution. The commonality between these two scenarios lies in the fact that the ratio 
f{i)/ip{i) of the activation rate and the vacation probability is linear in the queue length. Loosely 
speaking, this means that the amount of vacation time is inversely proportional to the queue length. 
This proportionality property also holds for polling systems and in particular vacation queues with 
so-called branching type service disciplines, where the number of customers served in between two 
vacations (switch-over periods) is proportional to the queue length at the start of the service pe- 
riod. Interestingly, the scaled queue length and delay for these types of service disciplines have 
been proven to converge to random variables with a gamma distribution in heavy-traffic conditions 
as well. The significance of the ratio f{i)/i(j{i) may also be recognized when the activation rate and 
vacation probability are in fact constant, i.e., independent of the queue length. In that case, the 
server is active a fixed fraction of the time which only depends on the activation rate and vacation 
probability through their ratio. 

In the second heavy-traffic regime, which emerges in scenario (i) described above, the scaled 
queue length and delay both converge to an exponentially distributed random variable with the 
same mean as in the corresponding ordinary M/G/1 queue without any vacations. In other words, 
the impact of the vacations completely vanishes in heavy-traffic conditions. Note that in this 
scenario the vacation probability falls off faster than the inverse of the queue length. 

The third heavy-traffic regime manifests itself when the vacation probability decays slower than 
the inverse of the queue length, e.g., like the inverse of the queue length raised to a power less than 
one. In that case, the queue length and delay, scaled by their respective means, converge to one in 
distribution, while the mean values increase an order-of-magnitude faster with the traffic intensity 
than in the first two regimes. 

While the above results are of independent interest from a queueing perspective, they are also 
particularly relevant for the analysis of distributed medium access control algorithms in wireless 
networks, which in fact was the main motivation for the present work. Emerging wireless networks 
typically lack any centralized control entity for regulating transmissions, and instead vitally rely on 
the individual nodes to operate autonomously and fairly share the medium in a distributed fashion. 
A particularly popular mechanism for distributed medium access control is provided by the CSMA 
(Carrier-Sense Multiple-Access) protocol. In the CSMA protocol each node attempts to access the 
medium after a certain back-off time, but nodes that sense activity of interfering nodes freeze their 
back-off timer until the medium is sensed idle. From a queueing perspective, the back-off times may 
be interpreted as vacation periods during which no transmissions take place, even when packets 
may be queued up. 

Despite their asynchronous and distributed nature, CSMA-like algorithms have been shown to 
offer the capability of achieving the full capacity region and thus match the optimal throughput 
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performance of centralized scheduling algorithms operating in slotted time \14:\ [T5l I19j . Based on 
this observation, various clever algorithms have been developed for finding the back-off rates that 
yield specific target throughput values or that optimize concave throughput utility functions in 
scenarios with saturated buffers [Ml [151 El] • 

In the same spirit, several powerful algorithms have been devised for adapting the back-off 
probabilities based on the queue lengths in non-saturated scenarios [HI [Ml EZj . Roughly speaking, 
the latter algorithms provide maximum-stability guarantees under the condition that the back- 
off probabilities of the various nodes are reciprocal to the logarithms of the queue lengths. Un- 
fortunately, however, such back-off probabilities can induce excessive queue lengths and delays, 
which has triggered a strong interest in developing approaches for improving the delay performance 
[21 [31 m [ini [El [201 [221 [26] . In particular, it has been shown that more aggressive schemes, where the 
back-off probabilities decay faster to zero as function of the queue lengths, can reduce the delays. 
The heavy-traffic results described above offer a useful indication of the impact of the choice of 
the back-off probabilities on the delay performance. It is worth observing that the vacation model 
does not account for the effects of the network topology, and highly aggressive schemes which are 
optimal in a single-node scenario, may in fact fail to achieve maximum stability in certain types 
of topologies [9]. However, the single- node results provide fundamental insight how the role of the 
back-off probabilities may inherently inflate queue lengths and delays. 

The remainder of the paper is organized as follows. In Section [2] we present a detailed model 
description. We provide an exact analysis of the model in Section [3l which yields formulas for the 
stationary queue length distribution in some specific cases. In Section [4] we derive lower and upper 
bounds for the mean queue length and we establish a stochastic relation between systems with 
different functions and /(•). We study heavy-traffic behavior in Section [5] and identify three 
qualitatively different regimes. In Section [6| we summarize our findings and discuss the implications 
for wireless networks. Finally, Appendix [A] contains some proofs that have been relegated from the 
main text. 

2 Model description 

We consider an M/G/1 queue with vacations. That is, we consider a queueing system with one 
server that can be active or inactive. Customers arrive according to a Poisson process with rate A, 
independent of the state of the system. Let a{t) indicate whether the server is active at time t 
{cr{t) = 1) or not {cr(t) = 0) and denote by L(i) the number of customers in the system at time t. 
When inactive, no customer is served and we say that the server is on vacation. The server becomes 
active after some time that may depend on the number of waiting customers at the beginning of the 
vacation period and the number of customers that arrive during the vacation period, but it may not 
depend on future arrivals. Denote by m) the probability that exactly m customers arrive during 
a vacation period that begins with i customers in the system, where <j) : [0, oo) x [0, oo) i— ?> [0, 1]. 
Further we assume (/)(0, 0) = 0, i.e. the server does not activate if no customers are present in 
the system. Let the random variable Xi denote the number of arrivals during a vacation period 
that begins with i customers in the system. We will assume that (/>(•) is such that E{Xj?} < oo. 
When active, customers are served and the service times, generically denoted by B, are generally 
distributed with distribution function Fb{-) and Laplace-Stieltjes transform B(-). We assume that 
E{i?^} < oo and that the service times are independent of the arrival and vacation times. Right after 
a service completion that leaves i customers behind, the server becomes inactive with probability 
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tp{i), where ■0 : [0, oo) i-^ [0, 1]. Further we assume '0(0) = li the server always becomes inactive 
if no customers are left in the system. 

Let p = XK{B} denote the traffic intensity of the system. Throughout this paper, we denote 
the generating function of a non-negative and discrete random variable W by Gwi'f') = E{r^}, 
with re [0, 1]. Note that 

oo 
m=0 

Let Wi = W2 denote that two random variables Wi and W2 are equal in distribution, so that 
F{Wi <w} = F{W2 < w} for ah w. Further, let Wi >st W2 denote that Wi is stochastically 
larger than W2, so that F{Wi < w} < ¥{W2 < w} for ah w. Finally, let Wi >st W2 denote that 
Wi is stochastically strictly larger than W2, so that Wi >st W2 and, additionally, P{VFi < w} < 
F{W2 < w} for some w. 



3 Exact analysis 

Denote by Z„ the number of customers just after the n-th service completion and by An the number 
of arrivals during the n-th service. Then (Zn)neNo constitutes a Markov chain with transition 
probabilities 

P{Z„+i = j\Zn = i} = {l- 0(z))P{^„ =j-i + l} + ^{i)F{Xi + Ar,=j-i + l}, 
for j > i — 1 and 

F{Zn+i = j\Zn = i} = 0, 
for j < i — 1. Because Xi and An are assumed to be independent, 

E{r^"+i|Z„ = i} = {l- i^{i)y-'GAAr) + mr''' G xAr)G A^r) 

= r^-'GAAr){l + miGxAr)-l)), (1) 

where GAnir) = B{X{1 — r)) for all n. Using this relation we can find a sufficient condition for 
stability of the system. 

Lemma 3.1. The Markov chain {Zn)nef^o positive recurrent if 

limsup V(i)E{Xi} <l- p. (2) 

Proof. This result is proved in using the results in |7]. For a short proof note that from ([T]) 
we find K{Zn+i\Zn = i} = i — l + p + ip{i)¥.{Xi}. The result now follows immediately from Pakes' 
Lemma j23j as E{Xj} < 00 for all i > by assumption. □ 

In words. Lemma 13.11 states that for stability it is sufficient that the system is busy serving 
customers more than a fraction p of the time if the number of customers in the system is large. 

We henceforth assume the system is stable, i.e. V(") fmd (/>(•) are such that the condition in ([2]) 
is satisfied. Let the random variable Z have the stationary distribution of the embedded Markov 
chain {Zn)neNo, i-e- 

F{Z = j} = lim F{Zn = j\Zo = k}, k> 0. 
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By the PASTA property and a level crossings argument we know that {P{Z = j},j > 0} is also 
the stationary distribution of the number of customers in the system L, with 

¥{L = j} = hm ¥{L{t) = j\L{0) = k}, 
for any k >0. Hence, using ([1]), we obtain the relation 

^ CO 

GL{r) = -B{X{1 - r)) (CiCr) + ^ i;{iy¥{L = i}{Gx, (r) - 1) 



i=0 

which corresponds to [11', Eq. (2)]. Equivalently, 

^^""^ B{X{l-r))-r ■ ^ ' 

Example 3.1. One activation scheme would be to never de-activate when the system is nonempty 
right after a service completion, i.e., = for i > 1. Similarly we could say that the server 
always activates immediately if there are waiting customers at the beginning of the vacation period, 
i.e., 0) = 1 for i > 1, and <j){i, m) = otherwise, so that (r) = 1 for i > 1. For this activation 
scheme ([3]) simplifies to 

^ , . ^ B{\{l-r))¥{L = 0}{l-Gxo{r)) 
' B{\{l-r))-r 

Using that GiiX) = 1 and applying I'Hopital's rule yields 
and hence 

^ ^ {l-p)B{\{l-r)){l-Gx,{r)) 
' E{Xo}{B{X{l-r))-r) 

Note that if the server waits for exactly one customer to arrive if there are no waiting customers at 
the beginning of the vacation period, i.e. Xq = 1, then @ becomes the classical Pollaczek-Khinchin 
formula for the standard M/G/1 queue without vacations. 



(l- p)^(A(l-r))(l - r) 
B{X{1 - r)) - r 

The Fuhrmann-Cooper decomposition [8] relates GL{r) to the Pollaczek-Khinchin formula 
through 

GL{r) = GL^^^^^{r)GL,{r), (6) 

where Lj denotes the number of customers in the system at an arbitrary epoch during a non-serving 
(vacation) period. This decomposition property can be derived from For this denote by -Lbcgin 
and -Lend the number of customers in the system at, respectively, the beginning and the end of a 
vacation period, and let 7 be the probability that the server becomes inactive after a departure, 

00 

7 = 5]V'(i)P{L = i}. 

i=0 
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Because the system is stable the expected number of arrivals between two service completions is 
equal to the expected number of service completions, which equals one. Therefore, 



p + 7(E{Lend}-E{Lbegin}) = 1, 

and the expected number of arrivals during a vacation period is therefore given by 

IE{ivend} — lE{Lbcgin} = — 

Further note that 

P{ibegin = i} = ^F{L = 

From (l3|) we now find 

(1 - p)B{X{l - r))(l - r) Er=oHiynL = m - GxAr)) 



GUr) 



B{X{l-r))-r (l-/))(l-r) 
Er=o^mrnL = ^}{l-GxAr)) 



Glm/g/A'^)' 

^ (. Er=ornLi,e,in = ^}{l-GxAr)) 

''"/'^/^^ ' (l-r)(E{Lend}-lE{ibcgin}) 



^00 



Gl, ■ (r) - Gl Ar) 

^ / \ -'-'begin \ / -'-'end \ / 

iM/G/iin _ r){W.{L,^^} - E{Lbcgin}) ' 

yielding ([6]), see [T]. Thus to find Giir) we can either solve equation ([3]) or find GLj{r) and then 
use the Fuhrmann-Cooper decomposition. 

In the remainder of this section we will analyze the system for several choices of (/>(•) and 

3.1 Equal vacation distributions 

In this subsection we assume that Xi = X for i > 1, with X some generic random variable. We 
further assume that X >st 0, so that with nonzero probability at least one customer arrives during 

any vacation. The case X = is already solved in Example 13.11 Next, if a vacation starts with no 
customers in the system, we assume that first X customers arrive. After this, if the system is still 
empty, the vacation is extended in an arbitrary way until at least one customer has arrived. We 

thus have Xo = XifX >st 1, i.e. if F{X = 0} = 0, and Xq >st X otherwise, i.e. if F{X = 0} > 0. 
To summarize, in this subsection we study the following scenario. 

Scenario 1. Xi = X >st for all i > 1 and either Xq = X and F{X = 0} = or Xq >st X and 
F{X = 0} > 0. 

Note that in this scenario we have Gxi{r) = Gx{t) for alH > and all r G [0, 1] if Gx(0) = 
and Gx^r) < Gx^f) = Gx{r) for alH > 1 and all r G [0,1) if Gx{0) > 0. So from Q and 
'0(0) = 1 it follows that 



B(X{1- r))(P{L = 0}(Gx(r) - Gxoir)) + (1 - Gx{r)) E.=o mr^L = i} ^ 

Giir) = = (7) 

^ ^ B{\{l-r))-r ^ ' 



Equation ([Tj) seems hard to solve in general, but we are able to find solutions for several specific 
choices for Before analyzing ([7]) in more detail we now first give a prototypical example of a 
system that belongs to Scenario [TJ This example describes a back-off mechanism used in wireless 
networks. 

Example 3.2. Consider a server that always waits for a certain time V, independent of the arrivals 
during this time. After this time the server activates if there are customers present in the system, 
and otherwise the server again waits for a time V (independent of the previous time) and repeats this 
procedure until there are customers present in the system. Assume V is generally distributed with 
distribution function Fv{-) and Laplace-Stieltjes transform V{-). Denoting by am the probability 
that exactly m customers arrive during a time V, 



ml 

we have (p{i,m) = Om, for i > 1, and (/>(0, m) = 0^/(1 — oo); for m > 1. Further, we get 

m=l m=l ^ ' 

where the interchange of summation and integration is justified by Beppo Levi's theorem, see 
e.g. [6]. Similarly, we get Gxi{r) = V{X{1 — r)) for i > 1. 

Note that if V is exponentially distributed with mean l/u we find Xi = X, i > 1, where X is a 
geometric random variable, with 

Further, Gxoir) = rGxi (^) as = Xi + 1 in this case. 

We will now use d?]) to find Gl{-) if = a* or = + 1), two functions that we will 
need in the heavy-traffic analysis of the system, see Section [5j For this purpose first introduce 

^ B{K^-r)){Gx{r)-Gxo{r)) .g. 
^ ^ B{X{l-r))-r ' ^ ' 

with K{r) = OiiXo = X. Define 

Y(r) = B{X{l-r)){l-Gx{r)) 

B{X{l-r))-r ^ ' 

and note that an alternative expression for Y{-) is given by 

^(0=Glm/g/iWGx^-W^, (11) 

with GL^^^Q^-^{r) the generating function of the number of customers in a standard M/G/1 queue 
without vacations ([5]), and Gxr°=(?') the generating function of the number of arrivals in a residual 
vacation period, 



^ros^ _ 1 - Gx{r) 



[I - r)E{X} 
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Similarly, we can write 

K(r)-rr (^^ Gx{r)-Gxoir) 

= GLM/G/iW(lE{Xo}G'xr(0-IEWGx-W)347- (12) 
Further, by I'Hopital's rule, 

rtl 1-/9 

Note that y(l) > as E{X} > and />< 1 for stability. Also note that K{1) > if >st X. 

Finally note that the generating function Gy/i''') of any non-negative discrete random variable 
Vl^ is a non- negative continuously differentiable function on [0, 1], as follows from the definition of 
a generating function. Hence Y{r) and K{r) are non-negative continuously differentiable functions 
on [0,1]. 

Theorem 3.2. For Scenario [1] and 'tp{i) = a* with < a < 1, i > 0, 
(i) IfXo^X, 



(ii) IfXo >st X, 



with ni=o5'(0 = 1 /'^'^ ^''^y function g{-). 

Proof. From Lemma l3.ll we obtain that the system is stable ifp<l, asO<a<l. We will now 
first prove the result for case (i), for which ^ simplifies to 

(15) 

i>(A(l — r)) — r 
Upon iteration this gives, using Gi(0) = P{L = 0}, 

00 

GL(r) = P{L = 0}JJy(aV). (16) 

1=0 

Finally, using Gl(1) = 1, we obtain 

Combining (I16h and (jl7p yields assertion (jl3p . In Lemma fA.ll we prove that ^(o*'') converges 
for all r E [0, 1], so in particular P{L = 0} > 0. 
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For case (ii) equation ([7]) simplifies to 

B{X{1 - r))(p{L = 0}{Gx{r) - Gx„{r)) + (1 - Gx(r))GL(ar)) 



Giir) 



B{X{l-r)) -r 
K{r)F{L = 0} + Y{r)GL{ar). 



Iterating this and using Gl(0) = F{L = 0} we get 

oo i — 1 oo 

GL{r) = P{L = 0} ( ^ K{a^r) JJ Y{a'r) + JJ Y{a'r) 
j=0 i=0 1=0 

Now note that Y{0) = 1 — Gx(0), so 1^(0) < 1 by assumption. Thus, as Y{-) is continuous and 
< a < 1, 

oo j-1 

Giir) = F{L = 0} ^ K{a^r) J| Y{a\). (18) 

j=0 i=0 

Prom ([18|) and = 1 we get In LemmaHHwe prove that ^'^=oK{a^r) Hto 'i^(aV) 

converges for all r € [0, 1], so in particular 

P{L = 0} = — ^ > 0, 

which completes the proof. □ 
Theorem 3.3. For Scenario [1] and ip{i) = l/(i + 1), i > 0, with a{r) = ^^dx, 



(i) IfXo = X, 



(ii) IfXo >st X, 

Giir) = P{L = 0} {K{r) + iMg-^C'^) K {y)e''^y'> dy'^ , (20) 

P{L = 0} = 3^ . (21) 

i^(l) + F(l)/o i^(x)e"(^)dx 

Proof. From Lemma 13.11 it follows that the system is stable if /? < 1 as limj_!.oo ^(*) = 0. For 
case (i), equation ([7]) gives 

^ , , ^(A(l - r))(l - Gx{r)) Egp i^rTjL = .} 

LrL(r) = ^ . 

^ ^ B{X{l-r))-r 

Now define 

oo ^ 

HL{r) = T-—r'-''nL = i}, 
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and note that H'^(r) = GL{r). Thus, HL{r) can be found by solving the differential equation 

r 

We thus get 

Hiir) = C ■ exp(^- ^^dx^ 

and 

where C is some constant. Using Gl{1) = 1 this gives ([T9|). 

For case (ii) we can find Hi^^r) by solving the differential equation 

H'^ir) = ¥{L = 0}K{r) + ^('^^^^ir) ^ 

r 

This gives 

HL{r) = e-"^'^) (¥{L = 0} K{y)e''^yUy + c) 

and 

GL{r) = P{L = Q}K{r) + iMg-^W {^{L = 0} K{y)e"^y'>dy + C 

for some constant C As Giir) is a generating function, boundary conditions are given by Gl{0) = 
F{L = 0} and Gl{1) = 1. 

To solve this boundary problem, note that, using integration by parts, 

a(r) = — log(r)y(r) — J Y' {x)\og{x)dx. 

Further Y{0) = 1 - Gx{0), so Y{0) < 1 in this case, and for ah x G [0, 1], Y'{x) < Y'{1) < oo as 
E{B'^} < oo and E{X'^} < oo. Therefore, 



(24) 



Y{r)^ 



Mr) = y(r)r^M-iexp(^ j Y'{x)log{x)dx^ 
and thus 

lim ^^e"'^^'') > limy(r)expf(y(r) - 1) log(r)')exp(-y'(l)) = oo. 

riO r rlO \ J 

Hence, to get Gl(0) = P{L = 0}, we need to set C = 0, so that (f24|l becomes 
GLir) = F{L = 0}(^K{r) + ^e'^^"^) K{y)e"^yUyy 

Finally, using Gl(1) = 1 we find ([20]). □ 

Equation ([7]) can be used to find Gl(-) for other functions jp{-) as well. For example, if ip{i) = 
g{i) for i < / and '4){i) = a* for i > I, for some function g{-), < g{-) < 1, and some I G Nq, one 
can use the same approach as used in the proof of Theorem 13.21 to find Gl{-) in terms of P{L = j}, 
J = 0, . . . , I — 1. Although interesting, it is beyond the scope of this paper to analyze this in more 
detail. 
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3.2 State-dependent vacation lengths 

In this subsection we consider a system that has state-dependent activation rules. More precisely, 
we assume that the server becomes active at the first jump of a non-homogeneous Poisson process 
with rate f{i) when L{t) = i. This gives the following scenario. 

Scenario 2. 

f(i + m) -p-r A 

<P{i,m) = ^ I I ^^-^.^^ i,m>0, 

X + f{i + m) j-J-^ X + f{i + j) 

where f : [0, oo) i-7> [0, oo) and /(O) = 0. 

Note that we need /(O) = as </>(0, 0) = if and only if /(O) = 0. 

Theorem 3.4. For Scenario [2] with ipli) = 1 and f{i) = ui, i > 0, 



5(A(1 -r))-r \Jr v{B{\{l - x)) - x) 

Proof. First note that, for all m > 0, (p{i,m) —?■ as i ^ oo. So E{Xj} and the system is 
stable if p < 1, see Lemma l3.ll 

To prove this theorem we will first determine Glj (r), and then GL{r) follows from the Fuhrmann- 
Cooper decomposition ([6]). 

In order to determine the distribution of Lj we cut out all the services and replace these by 
instantaneous jumps whose sizes are the number of arrivals during an arbitrary service time, 
with GL^{r) = B(\(l — r)). These jumps occur at rate vi when there are i customers in the system. 
Thus, as the function /(•) is linear, the distribution of Lj corresponds to that of a continuous-time 
branching process with immigration: Particles arrive as a Poisson process with rate A and each 
particle is independently and instantaneously replaced at rate v hy a new group of La particles. 
Branching processes of this type were studied by Sevast'yanov [25] and applying ^25i Theorem 1] 
to our situation yields 

G,,ir) = exp( ^-^i^--) dx). 

' \Jr U{B{X{1 - X)) - X) ) 

By dS]) we then obtain ([25|). □ 
3.2.1 Exponentially distributed service times 

For generally distributed service times it is difficult to interpret Theorem 13.41 but for exponentially 
distributed service times we can using the following result. 

Corollary 3.5. For Scenario [2] wzi/i 'ip{i) = 1 and f{i) = ui, i> 0, and exponentially distributed 
service times with mean l//i, 

G.(.)=(i^)'"''%(^-)V^ (26) 
Proof. Evaluating the integral in Theorem 13.41 with B{s) = gives (I26p . □ 
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Notice that (|26p is the product of two generating functions, so that the distribution of L is a 
convolution of a negative binomial distribution and a Poisson distribution. 

For exponentially distributed service times, and any choice of /(•) and '(/'(•), iLi{t),a{t))t>o is a 
continuous-time Markov process with state space {0, 1, 2, . . . } x {0, 1} and state (z, j) representing 
i customers in the system and j = when the server is inactive and j = 1 when the server is active. 
Transitions from (i,0) to [i + 1,0) and from (i, 1) to (i + 1, 1) occur at rate A, corresponding to 
an arrival of a customer, and transitions from (i, 0) to (i, 1) occur at rate f{i), corresponding to a 
server activation. Further, transitions from (i + l, 1) to {i, 0) occur at rate nip{i), corresponding to a 
service completion and server de-activation. Finally, transitions from + 1) to {i, 1) occur at rate 
yu(l — corresponding to a service completion without server de-activation. With 7r(i, /c) the 

stationary probability that the Markov process resides in state {i,k), we have the balance equations 

A7r(0,0) = /x7r(l,l), 

(A + /x)7r(l, 1) = /(l)7r(l,0) + /i(l-V'(l)M2,l), 

(A + /(i))7r(i,0) = A7r(i-l,0)+^V(i)vr(i + l,l), i > 1, 

(A + /i)7r(f , 1) = A7r(i-l,l) + /(i)^(i,0)+/i(l-VW)vr(i + l,l),i>2. 

This set of balance equations can be solved for several choices of /(■) and tp{-)- For example, 
f{i) = 6*, with b > 1, and ipli) = 1, i > 0, yields a result similar to the result of Theorem 13.21 Also, 
the result of Corollarv 13.51 can be derived in this way. 

The next theorem gives a class of functions for which the distribution of the total number of 
customers in the system in steady state is negative binomial. 

Theorem 3.6. For Scenario [2] with = k/{k + i), i > 1, and f{i) = fii/{i + k — 1), i > 0, with 
k >0, and exponentially distributed service times with mean 

GLir)= . (27) 



Proof. It can be checked that 



and 



pr 



solve the set of balance equations and the normalization equation J2i j T^ihi) = 1- Thus P{L = 0} 
7r(0, 0) = (1 - pf+^ and for i > 1, 



'{L = i} = TTii, 0) + nii, 1) = ^ ^) (1 - P)'+^ 



which gives ([27]). □ 

Note that the functions in Theorem 13.61 describe an M/M/1 queue if A; = 0, as one always has 
an immediate transition from (1,0) to (1,1) and there are no transitions from (i, 1) to {k,0) for 
any A; > if z > 2. 
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Further, k = 1 leads to a special case of Theorem l3.3l because ip{i) = l/(z + 1), i > 1, the service 
times are exponentially distributed with mean l/^u and the vacation discipline of Example 13.21 is 
used with the vacation time distribution identical to the service time distribution. 

The results of Corollary 13.51 and Theorem 13.61 could also be derived using a probabilistic ap- 
proach. For the situation of Corollary 13.51 the number of customers at an arbitrary epoch during 
a vacation period L/ can be related to the customers in a network of infinite-server queues with 
phase- type service requirement distributions. 

For the situation of Theorem 13.61 the vacation model behaves as an M/M/1 queue with k 
permanent customers and a Random-Order-of-Service (ROS) discipline. The ROS discipline selects 
the next customer for service at random from those which were in the queue just before the service 
completion, and excludes a permanent customer whose service may just have been completed. 



4 Bounds 

In Section [3] we derived exact results for several choices of (/>(•) and ip{-). In this section we will 
derive bounds for the mean number of customers in the system. These bounds will be used in the 
heavy-traffic analysis in Section [H 



4.1 Equal vacation distributions 

In this subsection we consider the class of vacation disciplines of Scenario [1] as described in Sub- 
section 13. 1[ For this class we find the following lower bound. 

Theorem 4.1. For Scenario [1] and when is a strictly decreasing convex function, 



Proof. In steady state, the mean number of activations per unit of time equals the mean number 
of de-activations per unit of time, so that 

= ^^E{W^'^'^^^^^ " EjT}^^'" = n L > 0}, (28) 

where a denotes the random variable with the steady-state distribution of the state of the server, 
i.e., 

P{o- = j} = lim P{o-(t) = i|cr(0) = /t}, 

and Z denotes, as before, the steady-state number of customers in the system right after service 
completions. Because Z = L and Pjcx = 1} = p, 

mmm < -^^r{a = 0} = ^^(1 - 0). 

Further, it follows from Jensen's inequality that, as is convex, 

E{^(L)} > m{L]). 
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Figure 1: Average number of customers in the system for = 0.8* and p € [0, 1) 



Since ip{-) is decreasing we then get 



(29) 



Finally, the Fuhrmann-Cooper decomposition ([6]) implies 

E{L} = |^ + P + ]EM, 
where Lj denotes the number of customers during a non-serving (vacation) period. We thus find 



(30) 



Combining pOj) with (f^^ gives the desired result. 

Another way to explain (j30p is that the average number of customers in a queue with vacations 
is at least the average number of customers in a queue without vacations, a standard M/G/1 
queue. □ 

In order to investigate how tight the bounds derived in Theorem 14.11 are, we consider the case 
of exponentially distributed service times with mean 1. Further assume the vacation discipline 
of Example 13.21 with the vacation time distribution identical to the service time distribution. By 
Theorem 13.61 we then find for ^(i) = l/(i + 1) that E{L} = 2/9/(1 — p), while Theorem 14.11 
gives E{L} > p/{l — p). So in this case the bound is off by a factor 2. We performed several 
numerical experiments for other de-activation probabilities ^(•). Two typical results are given in 
Figures [T] and [H which show simulation results for the average number of customers in the system 
for ^(i) = 0.8* and = (l/(« + l))'''*^, respectively. We further added the two lower bounds 
derived in Theorem 14.11 the inverse function bound (j29p and the bound that follows from the 
Fuhrmann-Cooper decomposition (I30p . Note that we used a log-lin scale for graphical reasons. 

For '(/'(i) = 0.8* we see that the simulation results are close to (j30p for values of p close to 
1, i.e. the bound in Theorem 14.11 seems rather tight in heavy traffic and the average number of 
customers is close to the average number of customers in a standard M/G/1 queue. 
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p 

Figure 2: Average number of customers in the system for ip{i) = + l))'^'^ and p € [0, 1). 

For ip^i) = (l/(i + l))*^'^ the simulation results are close to the inverse function bound (j29p for 
values of p close to 1, i.e. the bound in Theorem 14.11 seems rather tight in heavy traffic for this 
choice for as well. In Section [5] we will prove that the bound in Theorem 14. II is asymptotically 
exact in heavy traffic for the cases considered here. 

Next we compare the two processes {L{t),a{t)}t>o with de-activation probability and 
{L{t), a{t)}t>o with de-activation probability ?/'(•). 

Lemma 4.2. For the vacation discipline described in Example 13. 2L and assuming that ij)[i) > ip{i), 
i > 0, L(0) = L(0) and a{0) = a{0) = 0, {L{t)}t>o >st {L{t)}t>o. 

Proof. The proof is based on a coupling {{L*{t), o-*{t)}t>o, {L*it), cr*{t)}t>o) between {L{t),a{t)}t>o 
and {L(t),(j{t)}t>o- That is, we construct the sample path of the coupled systems recursively such 
that, marginally, this sample path obeys the same probabilistic laws as the original process. Fur- 
ther we make sure that arrivals in both systems happen at the same time and that the n-th service 
takes the same amount of time in both systems. We also make sure the n-th 'wait time', i.e. the 
time V described in Example 13.21 is equal in both systems. Finally, we make sure that the system 
with de- activation probability always de-activates if the system with de-activation probability 
'(/'(•) de-activates, if the total amount of customers in both systems is equal and a service ends in 
both systems. This will make sure that L*{t) > L*{t) for all t > 0. A formal proof is given in 
Appendix El □ 

Note that we only proved the result of Lemma 14.21 for the vacation discipline of Example 13.21 
For general vacation disciplines, which may depend on the arrival process. Lemma 14.21 does not 
always hold. It can for example be checked that Lemma 14.21 does not hold for Gxo('") = r^^^ , 
Gx{i~) = '^{i) = for i > 1 and ^/^(i) = 0.1 for i>l. 

Combining Lemma 14.21 and Theorem 14.11 leads to a lower bound for the mean number of cus- 
tomers in a system with de-activation probability ^(•) if there exists a strictly decreasing convex 
function -(/;(•) such that ilj{i) < 'tp{i) for all i. We get 
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4.2 State-dependent vacation lengths 

In this subsection we consider the vacation disciphnes obeying Scenario [2j For this class of vacation 
discipUnes we find the fohowing bounds. 

Theorem 4.3. For Scenario [2] and tjj{i) = 1, ^ > 0, 

(i) If f{-) is a strictly increasing, unbounded and concave function, 

(ii) If f{-) is a strictly increasing convex function, 

Proof. In steady state, the mean number of activations per unit of time equals the mean number 
of de-activations per unit of time, i.e., 

= = E{/(^/)}P{^ = 0}, (33) 

where L/ denotes the number of customers during a non-serving (vacation) period. 
If /(•) is concave, it follows by Jensen's inequality that 

E{/(L/)}</(E{L,}). 

Since /(•) is increasing, we thus get, as Pjo" = 1} = p and Pjcr = 0} = 1 — p. 

The Fuhrmann-Cooper decomposition ^ implies 

yielding ([3T]) . 

The bound in equation (j32p follows by symmetry. □ 

Note that f{i) = vi is both convex and concave. We thus find an exact result for this activation 
function, 

This also follows from the generating function, which we derived in Theorem 13.41 

In order to investigate how tight the bounds in Theorem 14.31 are for activation functions other 
than fii) = vi, we performed several numerical experiments. Two typical results are displayed in 
Figures [3] and [H showing for exponentially distributed service times with mean one the average 
number of customers in the system for f{i) = 1.25* — 1 and /(i) = i^'^ , respectively. For these 
activation functions we see that the simulated results are relatively close to their corresponding 
bounds for all values of p. In Section [S] we will prove that the bounds in Theorem 14.31 are in fact 
asymptotically sharp in heavy traffic. 

Next we compare the two processes {L{t),n{t)}t^Q with activation rate /(•) and {L(t), (T(t)}t>o 
with activation rate /(•). 
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Figure 3: Average number of customers in the system for f(i) = 1.25* — 1 and p S [0, 1) 




Figure 4: Average number of customers in the system for f(i) = i^'^ and p E [0, 1). 



Lemma 4.4. For Scenario [21 and assuming that f{i) < f{i), 
a{0) = a{0) = 0, {L{t)}t>o >,t {L{t)}t>o. 



1, i >0, L(0) = L(0) and 



Proof. The proof of this lemma proceeds along similar lines as the proof of Lemma [4.2^ i.e. it is based 
on a coupling {{L*{t),a*{t)}t>o,{L*{t),a*{t)}t>o) between {L{t), a{t)}t>o and {L{t),a{t)}t>o. We 
construct the sample path of the coupled systems recursively such that, marginally, this sample 
path obeys the same probabilistic laws as the original process. Further we make sure that arrivals in 
both systems happen at the same time and that the n-th service takes the same amount of time in 
both systems. Finally we make sure that the system with activation rate /(•) always activates if the 
system with activation rate /(•) activates, if the total amount of customers in both systems is equal 
and both systems are de-activated. This will make sure that L*{t) > L*{t) for all i > as both 
systems always de-activate after one customer is served. A formal proof is given in Appendix^ □ 



Combining Lemma 14.41 and Theorem 14.31 leads to an upper bound for the mean number of 
customers in a system with activation rate /(•) if there exists a strictly increasing convex function 
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/(•) such that f{i) < f{i) for ah i. We get 



]E{L}<E{L}<^|i^+p + ri 



2(1 -p) VI -p 

Similarly we find a lower bound for the mean number of customers in a system if there exists a 
strictly increasing unbounded concave function /(•) such that /(i) > /(i) for all i. 



5 Heavy-traffic results 

In this section we study the heavy-traffic behavior of the system. In particular, we derive the 
stationary distribution of the scaled number of customers in the system in heavy traffic, L/E{L} 
for /9 t 1- More precisely, we let A vary and study the system when A approaches 1/E{i?}. 

As an important byproduct, we obtain the limiting distribution of the stationary scaled sojourn 
time as p t 1 well. For this we consider the Laplace-Stieltjes transform of S'/E{S'}, 'E{e~'^^^^^^^}, 
with w > 0. By virtue of the distributional form of Little's law jl7j . the PASTA property and a 
level crossings argument we know that 

GL(r)=E{e-^(i-'^)^}, 

or equivalently, for E{L} > w, 

E{e-^/Emj ^ ^^(1 _ ^ E{(1 - ^-)"^"^^}- 

Noting that E{L} — )• oo as p t 1 using a generalized version of the continuous mapping theorem, 
see e.g. [16], we then find as p t 1 

S/E{S} -^W a and only if L/E{L} A W. 

Here W denotes some non-negative random variable and denotes convergence in distribution. 

Note that L and Xi in general depend on the value of p, which is not fixed in this section. To 
emphasize this we will therefore write GL{r,p) for the generating function of L and Gxi{r,p) for 
the generating function of Xi in this section. Similarly we write K{r,p) and Y{r,p) for K{-) and 
y(-) as defined in Q and (jlOp . Further, in order to analyze the system in heavy traffic, we need 
to make some technical assumptions on the vacation distribution in heavy traffic. That is, in this 
section we will consider Scenario [3] as described below and Scenario [2] with functions /(•) that grow 
monotonically to infinity. 

Scenario 3. Xi = X >st for all i > 1 and either Xq = X and P{X = 0} = or Xq >st X and 
W{X = 0} > 0. Further, E{X*} = limp^i E{Xj} exists and is finite for all i > 0, and 

for all i > and u > 0. 



-{l-p)u 



(34) 
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The additional assumptions in Scenario [3] ensure that the vacation disciphne behaves nicely 
when A approaches 1/E{i?}, i.e. when /? t 1 the vacation distribution for p is similar to the vacation 
distribution for p — e for small e, which is a desirable property from both a practical and theoretical 
perspective. 

One example of a vacation discipline that belongs to Scenario [3] is the prototypical example of 
the back-off mechanism used in wireless networks described in Example 13.21 For z > 1 we get 

|;G.,(r,p) = jlj^V"((l-r),/E{B}), 

and thus ()34p holds because E{y} < oo. For i = it can be checked in a similar way that (|34p 
holds. 

Denote by Exp(/3) a random variable having an exponential distribution with mean 1//3, and 
denote by r(a, /3) a random variable having a gamma distribution with shape parameter a and rate 
parameter /3. Define Rb = E{52}/(2E{S}), the mean residual service time, and vb = Rb/^{B}- 

Theorem 5.1. For Scenario [3] and = a* with < a < 1, i > 0, 

(1 -/9)L A Exp(i;-^) as pt 1- (35) 
Proof. Consider the Laplace-Stieltjes transform of (1 — p)L, with u > 0, and note that 

We will now use Theorem 13.21 to prove (j35p . For this define h{p) = e"^^^''^" and note that then, 
Yih{p),p) (1 - p)B{p{l - hip))/E{B}){l - Gx{h{p),p)) 



¥{1, p) E{X}(^(p(l - h{p))/¥.{B}) - h{p) 

Applying I'Hopital's rule twice. 



(37) 



y(^^^ ^fl + limf— -V^#Gx(r,p) )). (38) 

Ptl y(l,p) l + VBh'{l)\ Ptl V/i'(p)E{X}5/j ^^''^^ ^ ' 



r=h(p) 



By continuity of y(-), 

limy(a*/i(p),/)) = Y{a\l), 
ptl 

for i>l. From Theorem 13.21 we then find for Xq = X that 

limGL{h{p),p) = — — ^ = , 

Ptl l + VBh'{l) l + VBU 

which, by Levy's continuity theorem, gives (j35|) in case Xq = X. 
We also find 

( Gx{Hp),p) - Gxo{Hp),p) 
pn\ 1-Gxih{p),p) 

^^Gx{r,p) + h'{p)E{X} - f^Gxdr,p) " h'{pMXo} 



Ptl V -d_Gx{r,p)-h'{p)K{X} 

E{Xo}-E{X} ^ K{l,p) 
E{X} Y{l,p)- 



r=h(p) 



19 



and, for i > 1, 

lim ^^("'^(/")'/") - Gxo{a'h{p).p) ^ Gx{a\l) - GxM ^) 
In l-Gxia^h{p),p) 1-Gx(a%l) 

Further, from Theorem 13.21 we find, for Xq >st 

Y{h{p),p) l^j=o i-Gx{aJh{p),f;) lli=i n,(^pj,pj 



GL{h{p),p) 



as 



Gx{r,p) - Gxo{r,p) 



We thus obtain 



K{r,p) = Y{r,p)- 



Hm GL{h{p),p) 



1-Gx{r,p) 
1 1 



which proves ([55]) . □ 

It is striking that the result in Theorem 15. II is independent of the precise assumption on when 
the server returns from a vacation. In fact, the behavior is similar to the heavy-traffic behavior of 
a standard M/G/1 queue without vacations [18]. 

Remember that in this paper we assume E{i?^} < oo. This assumption is needed in the proof 
of Theorem 15. H but not in the proof of Theorem 13.21 If the service time distribution has a tail 
behavior like with 1 < < 2, i.e. the service time has finite mean and infinite variance, we can 
prove along similar lines as the proof of Theorem 15.11 that then the heavy-traffic behavior is similar 
to that of a standard M/G/1 queue without vacations as well [5]. 

If the server de-activates less frequently than in Theorem 15.11 then one would expect the same 
result as in Theorem 15.11 The next theorem proves this result for the vacation discipline of Exam- 
ple 13.21 Furthermore, we will prove a similar result for vacation disciplines in Scenario [2] with an 
aggressive activation function /(■). 

Theorem 5.2. For the vacation discipline described in Example 13.21 and ip{i) < a* with a G [0, 1), 
i > 0, and for Scenario^ with ip{i) = 1, i > 0, and /(•) a strictly increasing continuous and convex 
function with limj_>.oo ^"""^/"^(i) = 0, 

(1 -p)L A Exp(u^^) as pt 1- (39) 

Proof. First assume the vacation discipline of Example 13.21 is used with ip{i) < a\ a € [0,1). 
By Lemma 14.21 we have L <st L^i , where L^i denotes a random variable with the steady-state 
distribution of the number of customers in the system with 1^(1) = a* for all i. Further, L >st 
-^M/G/i- The result now follows from Theorem 15. 11 

Now assume Scenario [2] with ^(i) = 1, i > 0, and /(•) a strictly increasing continuous and 
convex function with linii^oo i^^ f^^ (i) = 0. From ([32]) we get, because limj^oo = 0, 

lim(l - p)E{L} < VB. (40) 
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Now consider the random variable W = (1 — p){L — i^M/G/i) ^^"^ note that W is nonnegative 
because L >st ^m/g/i ^'^d p < 1. Therefore, 

¥.{\W\} = = E{(1 - p)L] - E{(1 - p)Lm/g/i}- 

Thus as, 

hm(l - p)E{Lm/g/i} = VB, 

we find from (|40p that E{|1/^^|} = 0, hence W converges in mean to 0. Using Slutsky's theorem we 
then get 

{I- p)L = W + p)Lm/g/i ^ Exp(i;-i) as t 1, 
which completes the proof. □ 

Next we consider vacation disciplines that are less aggressive. First we will consider Scenario [3] 
with inversely proportional to the queue length and Scenario[2]with a linear activation rate /(•). 
For these vacation scenarios we will show that the heavy-traffic behavior does depend on the 
vacation scenario. 

Theorem 5.3. For Scenario [3] and = + 1), i >0, 

(1 - p)L A r(l + K{X*}v^\v^') as p t 1- (41) 
Similarly, for Scenario [2] with ij){i) = 1 and f{i) = ui, i> 0, 

{I- p)L ^T{1 + 1/{t,Rb),vI^) asptl- (42) 

Proof. The proof for Scenario [3] proceeds along similar lines as the proof of Theorem 15.11 We 
consider the Laplace-Stieltjes transform of (1 — p)L^ E{e~^^~''^"^}, with n > 0, and use (j36p and 
Theorem 13.31 to prove (141 p . For this define h{p) = e~^^~P)'^ and note that. 



pti Jh{p) X pti Jh(p) x{B{\{l - x)) - x) 



Pti Jo {l-s){B{\s)-l + s) 

Using Taylor expansion and noting that s = 0(1 — p) as p t 1 ™ the integration domain, 

V ^l'>dx = ^-^ / +0{l-p))ds 



hip) X 1-p Jo H + 



Thus, 



I — P V p vb V 1 — p 



/ /-^ y(x,p) , \ / N-E{x*}/«s 

limexp — / ax = 1 + uvb 
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We now find for Xq = X, using p8|) and Theorem 13.31 tliat 

limGUh{p),p) = (— 

ptl V 1 + UVb 

which, by Levy's continuity theorem, gives ()4ip in case Xq = X. 



For Xq >st X, using ([T2]) and (HI]), 



P{L = 0}i^(M/^),p) 



E{Xo}-E{X} + M^/;C(x,p)dx 
with 

C{x,p) = GL^^^^^{x)(E{Xo}Gxi''<x,p)-E{X}Gx^c.{x,p))e 

Thus limp|iP{L = 0}ii:(/i(/9), /)) = 0, as G{x,p) > 0. 
Similarly, 

1 /(f C(x, _ 1 



lim ■ 



Ptl 1 - P E{Xo} - E{X} + ^ /o C(x, p)dx ^{X} ' 
Hence by Theorem 13.31 and (jl3|) we find for Xq >st ^ that 

/ 1 \1+vbE{X*} 

lim GL{h{p),p) 



ptl \l + UVB 

as well, which proves (j4ip . 

For Scenario [2] with ^'(O = 1 and /(i) = vi, i > 0, note that 

-A(l-x) , -A /■i-'^(^) s 

-ax = / — as. 



lh{p)v{B{\{l-x))-x) V Jq B{\s)-l + s 

Using Taylor expansion gives 

A(l-x) -A fi-Mp) 



Jh(p) u(B(\(l - x)) -x) Jo 



5 + 0{l)]ds 

lh[p) y{B{\{l - x)) - x) V Jo \-ps + p^VBS^ + s 

'l-h{p) ^ 



rl-n(p) Y 



u{1-p)E{B}Jq Vi + p! 



u{l- p)E{B}\p^VB V 1-p 



Thus, 



/ / -A(l -x) , \ / \-V{^Rb) 
iim / expl — = ax 1 = 11 + uvb 



pnJhip) ^i^{B{X{l-x))-x) 
which, using Theorem 13.41 and Levy's continuity theorem, gives (j42p . 
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Instead of using the result in Theorem 15.11 one could also use the differential equations (j22p 
and ([23]) to prove Theorem 15.31 directly. 

We thus see that the heavy-traffic behavior of L does depend on the specific parameters if the 
vacation disciplines of Theorem 15.31 are used. We further see that the number of customers still 
scales like 1 — p in heavy traffic, i.e. (1 — p)L converges to a random variable. This is not the case 
anymore for vacation disciplines that are even less aggressive as the next theorem states. 

Theorem 5.4. For the vacation discipline described in Example 13.21 and tp{i) = l/{i + 1)" with 
a € (0, 1), i > 0, and for Scenario [2] with tp{i) = 1 and f{i) = vi"' with a G (0, 1), i > 0, 

^ -las ptl- (45) 



E{L} 

In particular, 



lim(l - p)i/"E{L} = E{X*}^/'^ 



for the vacation discipline described in Example 13.21 and 

lim(l - p)i/"E{L} = E{By 

for Scenario [2J 

We thus see for the vacation discipline described in Example 13.21 with the vacation probability 
inversely proportional to the queue length raised to the power a, a G (0, 1), and for Scenario [2] with 
a linear activation rate raised to the power a, a £ (0, 1), that (1 — p)L diverges. In fact, we see 
that for these vacation disciplines the number of customers in the system scales like (1 — p)^^" in 
heavy traffic. We further see that, using this appropriate heavy-traffic scaling, the scaled number 
of users in the system in heavy traffic has a degenerate distribution. 

In order to prove Theorem 15.41 we first introduce some additional notation. For any function 
g{-) : [0, oo) [0, oo) define, for a < 1, 6 > 1 and x G [0, oo), 

_ (6- l)g(ax) + (1 - a)g{bx) 
[b - a)g{x) 

Further define 

K'a,b = 1 - SUp7a,fc(x), 

X 

and 

Xa,b = 1 - inf 7a b(x). 

X 

The proof of Theorem 15.41 is based on the following proposition. 

Proposition 5.5. Assume g{-) is concave and Ka^b > for any a < 1 and b > 1, or g{-) is convex 
and Xa,b < for any a < 1 and b > 1. If 

rti g{E{W)) 

then 

W d , 
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The proof of Proposition 15.51 is deferred to Appendix [X] as it rehes on a few technical lemmas 
that are relegated from the main text. 

Having established Proposition 15. 5^ we can now prove Theorem [57 



Proof, (of Theorem 15. 4p For the vacation discipline described in Example 13.21 and 1^(1) = + 1)" 
with a G (0, 1), i > 0, we know from Theorem 14.11 that 

^ ^ - ^ \E{X}J' 

or, as = — 1, 

lim(l - /9)i/"E{X}-i/"E{L} > 1. (46) 
ptl 

Now consider the system with ^(i) = 1 for i < \ip~^{l3)'\ and ip{i) = /3 for i > \'ip^^{l3)'\, where 
/3 > and, for stability, /3 < (1 — p)/lE,{X}. Thus, by construction, > ip{i) for all i. Further 
assume that this system uses a vacation discipline similar to that of Example 13.21 but with a slight 
modification; the server only activates if at least \^p~^{|3)~\ + 1 customers are present in the system, 
instead of at least 1. That is, we have ['(/'~^(/3)l permanent customers. It follows immediately from 
Lemma 14.21 that L >st L. Further, using ([7]) we find 

^ ^ nL = \iJ-\mB{X{l - r)){Gx{r) - Gxp (r)) ^r^-i(g)i 
B{\{l-r))-r-{l-Gx{r))P 



with 



-Uo.,^ {l-p-(3XE{V}){l-V{X)) 



XE{V}V{X) 



Now take /3 = ^{x} ' ^ > 0' ^^^^ ^^^^^ from 1^ 

with limp^i C(/?)(l — p) < 00. Using that = — 1, we get 

(1 - p)i/"E{X}-i/"E{L} < (1 - J)-^/" + (1 - p)i/"E{X}-i/"C7(/5), 

and, hence, as < a < 1, 

lim(l - p)i/"E{X}-i/"E{L} < lim(l - 6)-^/" + (1 - p)i/"E{X}-^/"C7(p) < (1 - 5)"^/", 
ptl ptl 

for any 5 > 0. Thus, as L >st L, we find 

lim(l - /3)i/"E{X}-i/°E{L} < 1. 
ptl 



lim(l - /9)i/"E{X}-i/"E{L} = 1, (48) 
ptl 



Therefore, using equation (|46|) . 
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or 

lim*ffla)= 1 (49) 



From ()28p we find 

and hence, because P{L = 0}/(l — p) — )• as p t 1 by using Lemma 14.21 and an argument similar 
to 

Um^M^ = ^. 
Pti 1-/9 

Combining this with (j49p we find 

Hm^|4^ = l. 
pti V'(IE{L}) 

Further, because is strictly convex, 

{b - 1)(1 + ax)-" + (1 - a)(l + 



(6-a)(l + x) 

6 — 1/1 + ax \-" 1 — a/l + 6x 
+ 



b — a\ 1 + X J b — a \ 1 + X 
^ /6 — ll + ax_^l — al + 6x\-"_^ 
V6 — al + x b — a 1 + X / 

and the statement for the vacation discipline described in Example 13.21 follows from Proposition [53J 
The proof for Scenario [2] with = 1 and /(•) = with a € (0, 1), i > 0, proceeds along 
similar lines. First, using Theorem 14.31 we know 

or, as = (i/i^)^/", 

lim(l - p)i/"E{5}^/"z^i/°E{L} > 1. (50) 

Now consider the system with /(i) = for i < \f~^{f3)~\ and f{i) = /3 for i > [/^^ (/?)]. where 
/3 > and, for stability, /3 > -prr^yfj^- Thus, by construction, f{i) < f{i) for all i > 0. Further 

take ^(i) = 1 for all i > 0. We know from Lemma 14.41 that L >st 

We can find the generating function of L using ([7]). We can also find this generating function 
by noting that this system behaves as an M/G/1 queue with \f~^{gy\ permanent customers and 
service requirement -B + Exp(/3), i.e. the time required to serve a customer is the sum of the vacation 
time and the service time. 

Now take /3 = ^^_p^(f_^)^{B^^ , 5 > 0, which gives 

with limpii C{p){l — p) < oo. We then find in a similar way as before that 

lim(l - p)i/"E{S}i/"zy^/"E{L} < 1, 
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and hence, using (j50j) . 



lim(l - p)i/°E{S}i/"z^^/"E{L} = 1. 



Noting that Lm/g/i/IE{^} — > as /) t 1 we thus find, using the Fuhrmann-Cooper decomposi- 
tion dSD, 

hm(l - p)f(E{Li}) ^ 



Further, from (j33|) we find 



so that 



nm(l - p)E{f{Lj)} ^ 



pn' " E{B} 

Pti ^^(E{L,}) 



li.n5IM-l. (51) 



Finally, because /(•) is strictly concave. 



, , (6-l)a" + (l-a)6" (b-l l-a,\" ^ 

7a,b(x) = ^ ^ <(-h " + V 

— a \b — a b — a / 

and we find (j45p by invoking (jSip and Proposition 15. 5i □ 

The proof of Theorem 15.41 can be simplified if we assume E{i?^} < oo and E{X?} < oo for 
all i > 0. In that case we can find E{L^} along similar lines as we found E{L} in the proof of 
Theorem El It then follows that limp^i E{L2}/E{L}2 = 1 in this case, so that the assertion in 
Theorem 15.41 follows from Chebyshev's inequality. 



6 Conclusions 

In this paper we have obtained results for queues with random back-offs. Such random back-offs can 
be modeled by rates of activating during a back-off period /(■) and by the probability of initiating 
a back-off period after a service completion tp{-)- For various choices of /(•) and and under 
some additional assumptions, we have obtained exact expressions for the distribution of the number 
of customers in the system in Section O and bounds for the mean stationary number of customers 
in the system in Section H These results were employed to derive heavy-traffic limit theorems in 
Section [5l which showed the existence of a clear trichotomy, that can be best explained through 
the function V'(')- Clearly, in order for the system to be stable when p t li "^C') should eventually, 
as the number of customers increases, go to zero. This condition is also sufficient, see Lemma l3. 11 
Roughly speaking (for details and further assumptions see Section [S]), the queueing system with 
back-offs can display three modes of operation, depending on the asymptotic decay rate of tp{-). 
These three modes can be understood as follows: 

(i) The case = 1) represents the balanced regime, in which the heavy-traffic behavior 

is influenced by both the system behavior without back-offs, and the back-off periods. Hence, large 
queue sizes typically build up according to sample paths that display exceptional (interrupted) 
busy periods and exceptional sequences of back-off periods. The number of customers L is of the 
order 0((1 — and the more detailed information in Theorem 15.31 reveals a gamma distribution 
containing information of the arrival process, service times, and the back-off function. 
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(ii) When decays faster than l/(i + l), for mstance = 0{a^) with a E (0, 1), it is shown 
that the heavy-traffic behavior of the system is as if the back-off periods do not exist. The intuition 
is that when p t the system spends most of the time in states of large queue sizes in which the 
probabihty of initiating a back-off becomes neghgible. Indeed, in Theorem 15.11 it is shown that for 

= a* with a E (0, 1) the heavy-traffic behavior of the system is the same as that of an M/G/1 
system without back-offs. 

(iii) When -(/'(•) decays slower than l/(i + l), for instance for tp{i) = 0((i + l)~") with a G (0, 1), 
it is shown that the heavy-traffic behavior of the system is completely determined by the back-offs. 
Theorem 15.41 savs that for ^(i) = + 1)'^ with a G (0,1) the mean number of customers is 
0((1 — while the stationary distribution of the number of customers is degenerate and thus 
strongly concentrated around its mean. Hence, for systems with such back-offs, the heavy-traffic 
behavior is entirely different from that of systems without back-off (the M/G/1 system in this case). 

Another relevant observation that follows from the analysis is that the order of the number of 
customers in the system L in heavy traffic is independent of the mean length of the vacation and 
service times in all three modes. 

The revealed trichotomy for the single-node system provides some important insights for the 
wireless networks equipped with back-off rules similar as discussed in Section [H because the single- 
node system provides a best-case scenario for networks with multiple nodes. To see this, first notice 
that for a network to be in heavy traffic, the aggregated traffic intensity in some clique, a set of 
nodes of which at most one can be active at the same time, tends to 1. The total number of packets 
in this clique behaves like the number of packets in the corresponding single-node system with two 
modifications. First, the probability to go into back-off is based on a subset of all customers. Hence 
the network will be in back-off more often if ip(-) is decreasing and the total number of customers 
in both systems were equal. Second, the length of the vacation period is the minimum over the 
back-off lengths of all non-blocked nodes, which might change during the vacation period. We thus 
see that the vacation length is at least equal to the minimum back-off length of a node in the 
clique assuming none of the nodes is prevented from activating. Hence, taking this minimum as the 
actual vacation length in the corresponding single-node system, we see that vacations in the network 
always take at least as long as in the single-node system. As both modifications intuitively have 
a negative impact on the delay performance, it seems reasonable to assume that the total number 
of packets in the network is at best equal to the total number of customers in the corresponding 
single-node system. 

We thus see that more aggressive activation schemes can potentially improve the delay per- 
formance. On the other hand, however, these aggressive activation schemes may fail to achieve 
maximum stability and hence are unstable in heavy traffic. Maximum stability for general net- 
works is only guaranteed when xp{i) = 0(l/(log(z) + 1)) (see [ini HSl [Ml EZ] ) which, based on the 
analysis in this paper, might result in very poor delay performance in heavy traffic. An interesting 
topic for further research is to establish for which scenarios the delay performance in the network 
is roughly equal to the delay performance of the corresponding single-node system. 
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A Preliminary results and proofs 

This appendix contains a few technical lemmas and some proofs that have been relegated from the 
main text. To make this appendix self-contained we restate some results from the main text. 

Lemma A.l. (i) If Xq = X, then, 

oo 

llY{aW), 

1=0 

with < a < 1, converges for all r G [0, 1]. 
(ii) If Xo >st X, then, 

oo i-1 
J2K{a^r)llY{a'r), 

j=0 1=0 

with < o < 1, converges for all r G [0, 1]. 
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Proof. To prove case (i) first note that this infinite product converges if and only if 



X^(y(aV) - 1) 



i=0 



converges. To prove convergence of this infinite series we will use the ratio test (d'Alembert's 
criterion). We have, with h{r) = B{X{1 — r)) and k{r) = B{X{1 — r))Gx(?'), 



lim 



Y{a'+W) - 1 



y(aV) - 1 
By I'Hopital's rule, 



(— aV + /i(aV))(a*+^r — fc(a*+-'^r)) a^^^r — k(a^~^^r) 

lim : : : : = lim : : . 

j-5>oo (— a*+ir + /i(a*+^r))(aV — A;(a*r)) i-^oo a^r — k{a^r) 



, a'+^r - k(a'+^r) , 1 + XGx(a'+^r)B'(X(l - a'+^r)) - B(X(l - a'+^r))G'y(a'+^r) 
lim : , , . , — = lim a- 



air-k{a^r) i^oo 1 + AGx(aV)5'(A(l - aV)) - 5(A(1 - aV))G^(a^+ir) 
We thus find 

a < 1, 



lim 



Y{a'r) - 1 



provmg case (ij. 

For case (ii) note that 



for all r as < a < 1. Thus, by the ratio test, the series in case (ii) converges. □ 

Lemma 14.21 For the vacation discipline described in Example 13. 2^ and assuming that ilj{i) > ip{i), 
i > 0, L(0) = L(0) and a{0) = a{0) = 0, {L(t)}t>o >st {L{t)}t>o. 

Proof. To prove this lemma we will construct a coupling ({L* (t), a* {t)}t>o, {L* (t), a* {t)}t>o) be- 
tween {L{t),a{t)}t>o and {L{t),a{t)}t>o such that L*{t) > L*{t) for all t > 0. The result then 
follows. 

Let A, B and V be (infinite) vectors of realizations of independent random variables, where Ai is 
exponentially distributed with parameter A, Bi is generally distributed with distribution function 
Fb{-) and Vi is generally distributed with distribution function Fv{-). Further let Nv{t) and 
Nsit) be the total number of activations and service completions of the process belonging to tp{-). 
Similarly, let Nv{t) and Ns^t) be the total number of activations and service completions of the 
process belonging to We will construct a coupling such that L*{t) = L*{t) and a*{t) < cr*{t) 

or L*{t) > L*{t), N^rit) > N^{t) and N^{t) < N^{t), for ah t > 0. 

Denote by R{t) the remaining time until an activation or service completion in the process 
belonging to at time t and, similarly, denote by R{t) the remaining time until an activation or 
service completion in the process belonging to '(/'(■)• We make arrivals occur simultaneously in both 
processes and denote by J{t) the remaining time until an arrival. Initially set R{to) = R{to) = Vi 
and J(to) = Ai. 

Define the jump epochs = tq < ti < . . . . The jump epochs and the coupling are constructed 
recursively and we inductively prove the statement in the construction of this coupling. First take 
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L*(ro) = L(to), o-*(ro) = cr(ro), L*{to) = L{tq) and (t*(to) = <T(ro) and note that L*{tq) = L*{to) 
and a*{To) = a*{To) by assumption. Also, iVf (tq) = iV^.(ro) = 7V^(to) = iV^(ro) = 0. 

Now assume L*(Tj) = L*(ri) and a*{Ti) < a*{Ti) or L*(rj) > L*(ri), iVf (rj > N^in) and 
iV^(ri) < iV^(ri) for some i G Nq. Set r^+i = + min{i?(ri), ^(rj, J(ri)} and L*{t) = L*{Ti), 
L*{t) = L*{n), a*{t) = a*{n), a*{t) = a*{n), N*{t) = N*{n), N*{t) = N^{n), iV*(t) = iV*(ri) 
and N^{t) = Ngin) for all t G (Ti,Tj+i). So, by the induction hypothesis, L*{t) = L*{t) and 
a*{t) < a*{t) or L*{t) > L*{t), N*{t) > N*{t) and iV* (i) < N^{t) for all < t < Tj+i. To define 
the values at time Tj+i we distinguish nine cases. 

Case 1: Jin) = mm{R{Ti), Rin), Jin)}. Set L*(ri+i) = L*(ri) + 1, L*(ri+i) = L*(ri) + 1, 
a*{n+i) = a*{Ti),^a*{Ti+i) = a*{ri), N*{Ti+i) = N*{n), N*{n+il= iV* (r^),^ A^^(ri+i) = iV^(ri) 
and iV|;(Tj+i) = N^in). Further set Rin+i) = R{Ti) - n+i + n, Rin+i) = R{Ti) - n+i + n and 

Jin+i) = 

Case 2: Rin) = min{i?(ri), Rin), Jin)}, Rin) = Rin) and a*{Ti) = a*{Ti) = 0. Set L^n+i) = 
L*{n), L*{Ti+i) = L*{Ti), a*{Ti+i) = I{L*{ri)>o}, ^*{ri+i) = I|i.(^^)>o}, N^{n+i) = N^in) + 1, 
N^in+i) = N^in) + 1, N*s{Ti+i) = N*s{n) and iV* (Ti+i) = iV* (Ti). Further set R{n+i) = 

^TV* (r,+i)+lC^*(7"i+l) + "^V* (ri+i)+l(l " (^*{ri+l)), R{Ti+l) = B (n+i) + (1 - 

(T*(ri+i)) and Jin+i) = Jin) - Tj+i + n. 

Case 3: i?(ri) = mm{R{Ti) , R{Ti) , J (ri)} , R{Ti) = R{Ti) and <T*(ri) = <5-*(ri) = 1. Let Ui be a 
realization of a random variable that is uniformly distributed in [0, 1]. Now set L*(ri+i) = L*(ri) — 1, 

L*{Ti+l) = L*{Ti) - 1, 0-*(ri+i) = I{V,(L*(ri+i))<C/i}' = ^{^(L* (ri+i))<C/i} ' = ^vi'^i)^ 

N^in+i) = iV*(r,), A^^(ri+i) = N%{Ti) + 1 and iV^(ri+i) = N%{Ti) + 1. Further set R{n+i) = 

^7V* (r,+i)+l^*(^i+l) + " ^^^l^i+l)), = ^iV* (ri+i)+l'^*(^i+l) + ^JV^(r,+i)+l " 

(T*(rj+i)) and J(ri+i) = J(t;) - r^+i + n. 

Case 4: i?(rO = min{i?(r,), i2(ri), J(ri)}, i?(ri) < i?(ri) and a*{Ti) = 0. Set L*(ri+i) = L*(r,), 
L*(ri+i) = L*(ri), CT*{n+^) = I{L*(n)>o}, <^*(rm) = = A^^(ri) + 1, N^{n+^) = 

N^n), N^{n+i) = TV* (Ti) and iV* (r^+i) = TV* (r^). Further set i?(ri+i) = Sjv* + 

^iV* (ri+i)+l(l - R{Ti+i) = R{Ti) - Ti+i + and J(ri+i) = J{Ti) - Ti+i + Ti- 

Case 5: i?(rj) = min{i?(rj), i?(ri), J(rj)}, i?(rj) < i?(rj) and o"*(Tj) = 1. Let Ui be a realization 
of a random variable that is uniformly distributed in [0, 1]. Now set L*(rj_|-i) = L*(rj) — 1, L*(rj-|_i) = 
L*in), a*(ri+i) = I{^(L*(n+i))<t/0' = ^*(.n+i), N^in+i) = iV* (r,), iV* (r,+i) = iV* (r^), 

A^* (Ti+i) = N^in) + 1 and TV*(ri+i) = iV* (r^). Further set i2(ri+i) = 5^* (,^^^)+ia*(ri+i) + 
^iv* (ri+i)+i(l - cr*{n+i)), = ^(Tj) - n+i + Tj and J(ri+i) = J(ri) - r^+i + Tj. 

Case 6: A(Ti) = uim{R{Ti), Rin), Jin)}, Rin) > Rin) and a*{Ti) = 0. Set L*(ri+i) = L*(ri), 
L*(r,+i) = L*(r,), ^*(r,+i) = a*(r,), <T*(^m) = I{L*(n)>0}' ^y(^m) = ^^(^^+1) = 

N*{Ti) + 1, Af^(ri+i) = N^in) and iV* (ri+i) = iV* (r^). Further set i?(ri+i) = i?(r,) - r^+i + r^, 
Rin+i) = Sjy. (^^^^)_^^(T*(ri+i) + V^. - o-*(ri+i)) and J(ri+i) = Jin) - r,+i + r^. 

Case 7: -R(ri) = min{i?(ri), i?(Ti), J(ri)}, i?(rj) > -R(rj) and (5"*(ri) = 1. Let Ui be a realization 
of a random variable that is uniformly distributed in [0, 1]. Now set L*(ri+i) = L*(Ti), L*(Tj+i) = 
L*{Ti) - 1, a*{Ti+i) = a*{Ti+i), a*{Ti+i) = I{^(^*(^.^j))<[/.p N^in+i) = N^in), TV*(ri+i) = 

N^^in), N^in+i) = iV* (Ti) and iV* (r^+i) = iV* (r^) + L Further set Rin+i) = Rin) - n+i + n, 
R{Ti+i) = (^.^^)^i(T*(Ti+i) + V^* - '7*(ri+i)) and Jin+i) = Jin) - n+i + n. 
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Case 8: R{Ti) = mm{R{Ti) , R{Ti) , J(rj)}, Rin) = R{Ti), cr*(rj) = and (T*(rj) = 1. Let Ui be a 
realization of a random variable that is uniformly distributed in [0, 1]. Now set -L*(Tj+i) = L*(rj), 

L*{Ti+l) = L*{Ti) - 1, a*{Ti+i) = I|i.(^.)>o}, ^*{Ti+i) = I{^(^.(^^))<t;j, N^iU+l) = N*{Ti) + 1, 

iV{>(ri+i) = N^^in), N*B{Ti+i) = iV* (Ti) and iV^(r,+i) = iV^(ri) + 1. Further set Rin+i) = 

(T*(ri+i)) and J(ri+i) = J(ri) - r^+i + Ti. 

Case 9: R{Ti) = mm{R{Ti) , Rin) , J {n)} , R{Ti) = Rin), a*{Ti) = 1 and a*{Ti) = 0. Let Ui 
be a realization of a random variable that is uniformly distributed in [0, 1]. Now set L*(Tj+i) = 

L*{Ti) - 1, L*{Ti+i) = L*{Ti), <T*{Ti+i) = I{^(L*(t,))<C/,}' = ^{L*{n)>0}^ ^vin+l) = N{,{Ti), 

N^{n+i) = N^in) + 1, N%{Ti+i) = N%{n) + l and N*B{Ti+i) = N^in). Further set Rin+i) = 
BN*g{n+^)+i(^*{n+i) + V;v*(r,+i)+i(l - <^*{n+i)), R{n+i) = S^.(^^^^)+ia*(ri+i) + - 
(7*(ri+i)) and J(ri+i) = J(Tj) - n+i + n. 

Note that the remaining cases occur with probability zero as the random variables in the vector 
A are exponentially distributed. 

From the sample path construction we can deduce that 

L*{n) - L*{Ti) = N*s{n) - NUn). (52) 

Thus L*{Ti) = L*{Ti) if and only if N'^{Ti) = N^^Ti). Further we can deduce that 

R{n)-R{T,) = E E ^A. + (l-<^*(r.))^^.(.,)+i (53) 

j=Ar*(r,)+l fc=;v*{Ti)+l 

+'^*(^i)^^* - (1 - ^* in))VN^(^r,)+l - fT*(Ti)S^. (54) 

We now need to prove that L*(rj+i) = L*(rj+i) and a*(Ti+i) < (7*(Tj+i) or L*(rj+i) > L*(Tj+i), 
N^{Ti+i) > N^in+i) and iV^(Tj+i) < iV^(ri+i) in ah nine cases. 

For case 1 this follows immediately from the induction hypothesis. 

For case 2 note that (T*(rj+i) > a*{Ti^i) only if L*(ri+i) > L*(rj_(_i) = 0, so that the statement 
holds in this well. 

For case 3 note that ■0(L*(Tj)) > ip{L*{Ti)), so that (T*(ri+i) < (T*(rj+i) if Z/*(Tj+i) = L*(rj+i). 
The statement now follows. 

For case 4 first assume that L*[Ti) = L*{Ti). Then it follows from the induction hypothesis 
that cr*(Tj) = o"*(Tj) = 0, and from equation (f52|) it follows that N'^{Ti) = N^{Ti). Then, for 
R{Ti) < R{Ti) to hold we need Nyiri) > Ny{Ti) as follows from equation ([53]). If I/*(rj) > L*(rj) 
we have N^in) > N^iTi). Thus we again need -/Vy(ri) > Ny{Ti) in order to have R{Ti) < R{Ti). 
The statement now follows. 

For case 5 the statement follows immediately from the induction hypothesis. 

For case 6 first assume that L*(Ti) = L*{Ti) and o-*(rj) = a*{Ti) = 0. Following the same 
reasoning as for case 4 this yields that we need Ny{Ti) < Ny{Ti) to have -R(rj) > R{Ti), contradicting 
the induction hypothesis. Thus it not possible to be in case 6 if L*{Ti) = L*{Ti) and c*(Tj) = 
(T*(rj) = 0. For all other situations the statement is easily seen to hold. 

For case 7 first assume that L*{Ti) = L*{Ti) and (T*(ri) = ^*{Ti) = 1. Following the same 
reasoning as in case 6 this would yield that we need Nyiji) < Ny{Ti), which contradicts the 
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induction hypothesis. Thus it is only possible to be in case 7 if L*{Ti) > L*{Ti), and hence 

For case 8 note that L*(rj) > L*{Ti), as (T*(Tj) < (J*(rj). Thus, using equation ([52]), N^{Ti) > 
N^{Ti) and, using equation ([53|) . A^y(rj) < iVy(rj). The statement now follows as a*{Ti+i) > 
a*{Ti+i) only if L*{Ti+i) > L*(ri+i) = 0. 

For case 9 the statement follows immediately from the induction hypothesis. 

Finally, it can be verified that the marginal distributions of {L*{t), cr*(t)}t>o and {L*{t),a*{t)}t>o 
are the same as the distribution of {L{t),a{t)}t>o and {L{t), a{t)}t>o. □ 

Lemma 14.41 For Scenario [2l and assuming that f{i) < f{i), = 1, i > 0, L{0) = L{0) and 
a{0) = (7(0) = 0, {L{t)}t>o >st {L{t)}t>o. 

Proof. The proof of this lemma proceeds along similar lines as the proof of Lemma 14.21 That 
is, we will construct a coupling {{L*{t),a*(t)}t>o,{L*(t),a*{t)}t>o) between {L{t),a(t)}t>o and 
{L{t),&{t)}t>o such that L*{t) > L*{t) for aU t > 0. The result then follows. 

We will construct the sample path of the coupled systems recursively such that, marginally, 
this sample path obeys the same probabilistic laws as the original process. Further we make sure 
that arrivals in both systems happen at the same time and that the n-th service takes the same 
amount of time in both systems. Finally we make sure that the system with activation rate /(•) 
always activates if the system with activation rate /(•) activates, if the total number of customers 
in both systems is equal and both systems are de-activated. This will ensure that L*{t) > L*{t) 
for all t > as both systems always de-activate after one customer is served. Now we will formally 
construct this coupling. 

Let A, B and V be (infinite) vectors of realizations of independent random variables, where Ai 
is exponentially distributed with parameter A, Bi is generally distributed with distribution function 
Fb{-) and Vi is exponentially distributed with parameter 1. Further let Nsit) be the total number 
of service completions of the process belonging to /(•). Similarly, let Nsit) be the total number of 
service completions of the process belonging to /(•). 

Denote by R{t) the remaining time until an activation or service completion in the process 
belonging to /(•) at time t and, similarly, denote by R{t) the remaining time until an activation 
or service completion in the process belonging to /(•). We make arrivals occur simultaneously in 
both processes and denote by J{t) the remaining time until an arrival. 

We will construct a coupling such that L*{t) > L*{t), or L*{t) = L*{t) and = a*{t) < a*{t) = 
1, or L*{t) = L*{t), a*{t) = a*{t) and R{t) > R{t), for aU t > 0. 

Define the jump epochs = tq < ti < . . . . The jump epochs and the coupling are constructed 
recursively and we inductively prove the statement in the construction of this coupling. First take 
L*(ro) = L(to), (7*(to) = (7(to), L*{to) = L{tq) and (T*(ro) = <t(to) and note that L*{to) = L*{tq) 
and (5"*(ro) = <7*(ro) by assumption. Further set N^{tq) = A''^(ro) = 0, J{to) = Ai and R{tq) = 
R{ro) = Vi/fiL*{ro)), where 1/0 = po. 

Now assume L*{Ti) > L*{Ti), or L*{Ti) = L*{Ti) and = (T*(rj) < (J*{Ti) = 1, or L*(rj) = L*{Ti), 
a*{Ti) = a*{Ti) and -R(rj) > -R(rj), for some i e Nq. Set Tj+i = + min{i?(ri), ^(tj), J(rj)} 
and L*{t) = L*in), L*{t) = L*{Ti), a*{t) = a*{Ti), a*{t) = (7*(r,), R{t) = Rin) - t + n and 
R{t) = R{Ti) — t + Ti for all t E (Tj,Tj+i). So, by the induction hypothesis, L*{t) > L*{t), or 
L*{t) = L*{t) and = a*{t) < a*{t) = 1, or L*{t) = L*{t), a*{t) = a*{t) and R{t) > R{t) for ah 
Ti < t < Tj+i. To define the values at time Tj+i we distinguish seven cases. 
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Case 1: J(ri) = mmiRin), R{n), Jin)}. Set L*{ri+i) = L*{ri) + 1, L*(t,+i) = L*{n) + 1, 
a*{T,+i) = a*{T,), <T*(r,+i) = a*{n), iV^(r,+i) = iV^(rO and N^n+i) = N*s{Ti). Further set 
i?(ri+i) = (i?(r,) - Ti+i + ri)a*(r,+i) + (1 - a*(ri+i))l^i+i//(L*(ri+i)), i2(ri+i) = (i?(ri) - r^+i + 
Ti)a*{Ti+i) + (1 - <7*(ri+i))Fi+i//(L*(ri+i)) and Jin+i) = Ai+i. 

Case 2: Rin) = mm{R{Ti), R{n), Jin)}, Rin) = R{n) and a*{Ti) = a*{n) = 0. Set L*(ri+i) = 
L*iTi), L*{Ti+i) = L*{n), a*(ri+i) = 1, a*{n+i) = 1, N*s{n+i) = N*s{n) and iV^(ri+i) = iV^(r,). 
Further set i?(-rj+i) = Sjy* i?(ri+i) = 5Ar.(^^^^)+i and J(ri+i) = J(rj) - r^+i +ri. 

Case 3: Rin) = mm{R(Ti) , R{Ti) , J (ri)} , R^n) = R^n) and cr*(rj) = (T*(ri) = 1. Set L*(rj+i) = 
L*{Ti)-l, t{Ti+i) = L*{Ti)-l, a*{Ti+i) = 0, a*{Ti+i) = 0, iV^(ri+i) = Af^(ri) + 1 andiV^(ri+i) = 
N*B{ri) + 1. Further set Rin+i) = V^+^ / f {L* (n+i)) , Rin+i) = Vi+i / f {L* [n+i)) and J(t,+i) = 
J(rj) - Tj+i + Tj. 

Case 4: i2(ri) = min{i?(ri), ii(ri), J(ri)}, i?(ri) < Rin) and C7*(ri) = 0. Set L*(ri+i) = L*(ri), 
L*{Ti+i) = L*{Ti), a*{Ti+i) = 1, <T*(ri+i) = <T*(ri+i), iV^(ri+i) = iV* (r^ and iV* (r^+i) = iV* (ri). 
Further set ii(rj+i) = ^at* -R(Ti+i) = -R(ri) - n+i + and J(rj+i) = Jin) - r^+i + n. 

Case 5: i?(ri) = mm{R{Ti) , R^n) , J (n)} , Rin) < R{Ti) and a*{Ti) = 1. Set L*(ri+i) = 
L*{Ti) - 1, L*(r,+i) = L*{Ti), a*{Ti+i) = 0, <t*(t,+i) = a*(r,), iV^(ri+i) = N%{n) + 1 and 
iV^(ri+i) = iV^(ri). Further set R{Ti+i) = Vi+i / f (L* (n+i)) , Rin+i) = (%i)-^m+^i)<^*(^m) + 
(1 - a*{Ti+i))Vi+i/f{L*{Ti+i)) and J(ri+i) = Jin) - r^+i + r^. 

Case 6: R{Ti) = mm{R{Ti), Rin), Jin)}, Rin) > Rin) and a*{Ti) = 0. Set L*(ri+i) = L*(ri), 
L*(ri+i) = L*(ri), ^*(r,+i) = a*{n), <T*(r,+i) = 1, N*^{ri+i) = iV*(ri) and iV* (r^+i) = iV*(r,). 
Further set ii(ri+i) = R{Ti) - n+i + n, Rin+i) = ^^v* (r,+i)+i ^^"^ = •^('^i) " + ^i- 

Case 7: ii(ri) = mm{R{n) , R{n) , J (n)} , Rin) > Rin) and a*{Ti) = 1. Set L*(t,+i) = L*(r,), 
L*(ri+i) = L*{Ti) - 1, a*(ri+i) = a*{Ti), a*{Ti+i) = 0, A^^(ri+i) = iV^(rO and iV^(ri+i) = 
iV* (Ti) + 1. Further set Rin+i) = {Rin) - n+i + Ti)a*{Ti+i) + (1 - a* {Ti+i))Vi+i / f {L* {n+i)) , 
R{Ti+i) = Vi+i/ f{L*{Ti+i)) and Jin+i) = J{Ti) - n+i + Tj. 

Note that the remaining cases occur with probabihty zero as the random variables in the vectors 
A and V are exponentially distributed. 

From the sample path construction we can deduce that 

L*{ri) - L*{n) = N%{Ti) - N%{Ti). (55) 

Thus L*{Ti) = L*{Ti) if and only if N%{Ti) = N%{n). 

We now need to prove that L*(rj+i) > L*(rj+i), or L*(rj_(_i) = L*(rj_|_i) and = (T*(rj+i) < 
o-*(rj+i) = 1, or L*(rj+i) = L*(ri+i), a*(ri+i) = o-*(rj+i) and ^(rj+i) > i?(ri+i) in all seven cases. 

For case 1 it follows immediately that L*(rj-|_i) > L*(rj-|_i) if L*(Ti) > L*{Ti). We also find 
immediately that L*(Tj+i) = L*(Tj+i) and = (T*(ri+i) < cr*(rj+i) = 1 if L*{Ti) = L*{Ti) and 
= a*{Ti) < (T*{Ti) = 1. Further, we see that L*(ri+i) = L*(rj+i), <T*(rj+i) = o-*(ri+i) = 1 
and R{Ti+i) > R{Ti+i) if L*{Ti) = L*{Ti), a*{Ti) = a*{Ti) = 1 and Rin) > Rin). Finally, if 
L*{Ti) = L*{Ti) and a*{Ti) = o-*(Tj) = we get L*(ri+i) = L*(ri+i), (T*(rj+i) = cr*(ri+i) = and 
R{Ti+i) > R{Ti+i) as /(L(r,+i)) < /(L(Ti+i))._^ 

For case 2 recall that N^^Ti) = iV^(rj) if L*{Ti) = L*(Ti), as follows from equation (I55p . Thus 
R{Ti+i) = i?(rj+i) if L*(rj+i) = -L*(rj+i). The statement now follows. 

For case 3 note that /(I/(rj+i)) < /(L(rj+i)) if L*(Tj+i) = L*(rj+i), which gives i?(rj+i) > 
i?(rj+i) in that situation. For all other situations the statement is easily seen to hold. 
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For case 4 it follows immediately that Z/*(Tj+i) — (T*(Ti+i) > L*(rj+i) — o"*(ri_(_i). Therefore, 
L*(ri+i) > L*(ri+i), or L*(ri+i) = L*(ri+i) and = a*{Ti+i) < cr*{Ti+i) = 1. 

For case 5 we get L*(rj-|_i) > L*(rj+i), as follows immediately from the induction hypothesis. 

For case 6 note that either L*{Ti) > L*(Ti), or L*{Ti) = L*{Ti) and = (T*(Tj) < cr*(ri) = 1. If 
L*{Ti) >L*{Ti) we get L*{n+i) > L*(ri+i). Further, if L*(ri) = L*(ri) and = a*{Ti) < a*{Ti) = 1 
we get L*(ri+i) = L*(rj+i), a*(rj) < cr*(ri) = 1 and, as N%{Ti) = N%{Ti) by equation ([55]), 

i?(ri+l) < Sjv- + l - + ^» ^ ^7V* (r,+i) + l = 

For case 7 note that L*{Ti) > L*{Ti). If cr*(rj-|_i) = 1 the statement immediately follows. If 
a*{Ti+i) = and L*(ri+i) = L*(ri+i) we find i?(ri+i) > Rin+i) as /(L(ri+i)) < /(L(ri+i)). 

Finally, it can be verified that the marginal distributions of {L*{t), cr*{t)}t>o and (T*(t)}t>o 
are the same as the distribution of {L{t), a{t)}t>o and {L{t),(T{t)}t>o- For this note that the ex- 
ponential distribution is memoryless and that kW ~ Exp(/3/A;) if ~ Exp(/3). □ 

Lemma A. 2. If ay + {1 — a)z = a'y' + (1 — a')z' , with < a,a' < 1 and y' < y < z < z' , then 

(i) If g{-) is a concave function, 

ag{y) + (1 - a)g{z) > a'g{y') + (1 - a')g{z'). (56) 

(ii) // g{-) is a convex function, 

ag{y) + (1 - a)g{z) < a'g{y') + (1 - a')g{z'). (57) 

Proof. Since y' < y < z < z', there exist < ay,az < 1, such that y = Oyy' + (1 — ay)z', 
and z = Uzy' + (1 — az)z'. It follows from the equality ay + (1 — a)z = a'y' + (1 — a')z' that 
a' = aay + (1 — a)az, and 1 — a' = a{l — Oy) + (1 — a)(l — Oz)- Further, if g{-) is concave, 

o^y9{y') + (1 - ay)g{z') < g{y), 

and 

azgiy') + (1 - az)giz') < g{z). 

We may then write 

ag{y) + (1 - OL)g{z) > a[ayg{y') + (1 - ay)g{z')] + (1 - a)[a^5'(y') + (1 - az)g{z')] 
= [auy + (1 - a)az]g{y') + [a(l - a^) + (1 - a)(l - a^)]5(z') 
= a'5(y') + (l-a')5(^'), 
which completes the proof for case (i). The inequality in (I57p follows by symmetry. □ 

Corollary A. 3. For all x, if a' < a < 1, b' > b > 1, then 

(i) If g{-) is a concave function, 'ja'fi'ix) < ^a,b{x) < 1 and thus Ka'^b' ^ '^a,b ^ 0. 

(ii) If g{-) is a convex function, ja',b'{x) > ^a,b{x) > 1 and thus Xa',b' < Xa,b < 0. 

Proof. Taking y = ax, y' = a'x, z = bx, z' = b'x, a = {b — l)/{b — a), and a' = {b' — l)/{b' — a') 
in (|56|) . we obtain for g{-) concave, 

{b - l)g{ax) + {1 - a)g{bx) / x , ^ w ^ 
b — a 

^ 'fr,^(, . /^ jb' - l)gia'x) + (1 - a')g{b'x) 

> a g{y ) + (1 - a )g{z ) = iy^' ' 
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which yields the statement for concave g(-). 

The assertion for convex g{-) follows by symmetry. □ 

Let W henceforth be a nonnegative integer- valued random variable with probability distribution 
p{x) = F{W = x}. For any y >0, define F{y) = F{W < y} = F{W < [y\}, with pseudo inverse 

F-\u) = mf{y : F{y) > u} 

for any u G [0, 1] , so that we may write 

n9(W)}= C g{F-\u))du, 

Ju=0 

and in particular 

]K{W}= [ F-^{u)du. 

Ju=Q 

For compactness, denote F~^{u) = F~^{u)/E{W}, 

1 f"^ - 
xi{ei) = — / F~^(u)du, 

ei Ju=0 



u=0 

and 



1 

X2{e2) = — / F-\u)du. 

€2 Ju=l-e2 



Lemma A.4. Let < ei < F{E{W}), < €2 < 1 - F{E{W}), so that xi(ei) < F"^(ei) < 1 and 
2:2(62) > F-\l-e2) > I, with 

eia;i(ei) + €2X2(62) = ei + €2, 

or equivalently, 



rl-e2 ^ 

/ F~^{u)du = 1 — ei — 62- 

ti=ei 



(i) If g{-) is a concave function, 



fe + «.K,(,„«(«,<i-™|- (58) 



(ii) If g{-) is a convex function, 



(59) 



Proof. Write 



n9{W)}= r g{F-\u))du+ [' g{F-\u))du+ [' g{F-\u))du. (60) 

Ju=0 Ju=ei Ju=l—e2 

Because of Jensen's inequality we find for concave g{-) 

C g{F-\u))du < (1 - ei - €2)5 {--, ^ F-\u)dv) = (1 - ei - e2)g{HW}). 

Ju=ei V i - ei - £2 Ju=ei J 



36 



Invoking Jensen's inequality once again, 



g{F-\u))du+ f g{F-\u))du 

I u=0 Ju=l—e2 

< eig {- [ ' F'\u)du) +€29 (- [ F-\u)du 

V^l Ju=Q J Ju=l-t2 

= eig{x^{ei)E{W}) + e2g{x2{e2)E{W}) 
= lM^^),M^2mW}){ei + e2)gmW}) 

< (l-Ac,.,(.,),x.M)(ei + e2)<?(IEW). 



Substituting the above two inequalities in (j60p we obtain the statement of the lemma for concave 
g{-). The assertion for convex g(-) follows from symmetry. □ 

Lemma A. 5. Let < ei < F(E{W}), < 63 < 1 - F{E{W}), so that xi(ei) < F"^(ei) < 1 and 
3:2(62) > F-^{1 - £2) > 1, with 

eixi(ei) + 62x2(62) = 61 + 62, 

or equivalently, 

/ F"^(n)du = 1-61 -62. 

(i) If g{-) is a concave function, 

(ii) If g{-) is a convex function, 

Xxi(ei),X2(e2) - ™™{Xj7'-l(fj)_i + fl(i_j7'-l(e^)), Xi_f2(/'-l(i_e2)-l),F-l(l-f2)J'' 

Proof. Observing that 

X2(62) > F~l(l -62), 

we obtain 

6lXl(6l) < 61 + 62 - e2F-^{l - 62) = 61 + 62(1 " F'^ {I - 62)). 

In addition, 

Xl(6l) < F"^6l), 

yielding 

XI (61) < min{F-i(6i), 1 - ^(F-i(l - 62) - 1)}. 

61 



Likewise, 

Combining the above two inequalities and using Corollary IA.3I completes the proof. □ 



X2(62) > max{F-i(l - 62), ! + -(!- F-i(6i))}. 

62 
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Proposition 15.51 Assume g(-) is concave and Ka,b > for any a < 1 and b > 1, or g{-) is convex 
and Xa,b < for any a < 1 and b > 1. If 

then 

Proof Take 5 > and ei = F((l - 6)E{W}). Then either ei = 0, or < ei < F{E{W}) and 
xi{e) < F~^(ei) <1 - 6. In the latter case, define €3 = 1 - F~'^{E{W}), and observe that 



/ F-\u)du < 1 - ei - el, 

J u=ei 



while 



/ F~\u)du > 1 - ei. 

J u=ei 

Hence, by continuity, there must exist an €2 G (0,62) with X2ie2) > 1 and 

/ F~^{u)du = 1 — ei — £2, 

SO that the assumptions of Lemmas IA.4I and IA.5I are satisfied. Applying these two lemmas then 
yields for concave g{-) 

^F-'L{ei),l+ei{l~F-'^{ei)) - '^F-l(ei),l+il(l-F-l(ei)) aS p t 1. 



This means that ei = ¥{W < (1 — 5)E{VF}} — )• as p t 1- A similar argument shows that 
F{W > (1 + 5)E{VF}} — > as p t 1- It iiow follows from the definition of convergence in probability 

that converges to 1 in probability. Hence we conclude that -— 1 as p t 1 if is 

concave. 

The proof for convex g{-) follows by symmetry. □ 
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